Search for: All records

One developing approach for robotic control is the use of networks of dynamic neurons connected with conductance-based synapses, also known as Synthetic Nervous Systems (SNS). These networks are often developed using cyclic topologies and heterogeneous mixtures of spiking and non-spiking neurons, which is a difficult proposition for existing neural simulation software. Most solutions apply to either one of two extremes, the detailed multi-compartment neural models in small networks, and the large-scale networks of greatly simplified neural models. In this work, we present our open-source Python package SNS-Toolbox, which is capable of simulating hundreds to thousands of spiking and non-spiking neurons in real-time or faster on consumer-grade computer hardware. We describe the neural and synaptic models supported by SNS-Toolbox, and provide performance on multiple software and hardware backends, including GPUs and embedded computing platforms. We also showcase two examples using the software, one for controlling a simulated limb with muscles in the physics simulator Mujoco, and another for a mobile robot using ROS. We hope that the availability of this software will reduce the barrier to entry when designing SNS networks, and will increase the prevalence of SNS networks in the field of robotic control. 

This article is a historical perspective on how the study of the neuromechanics of insects and other arthropods has inspired the construction, and especially the control, of hexapod robots. Many hexapod robots’ control systems share common features, including: 1. Direction of motor output of each joint (i.e. to flex or extend) in the leg is gated by an oscillatory or bistable gating mechanism; 2. The relative phasing between each joint is influenced by proprioceptive feedback from the periphery (e.g. joint angles, leg load) or central connections between joint controllers; and 3. Behavior can be directed (e.g. transition from walking along a straight path to walking along a curve) via low-dimensional, broadly-acting descending inputs to the network. These distributed control schemes are inspired by, and in some robots, closely mimic the organization of the nervous systems of insects, the natural hexapods, as well as crustaceans. Nearly a century of research has revealed organizational principles such as central pattern generators, the role of proprioceptive feedback in control, and command neurons. These concepts have inspired the control systems of hexapod robots in the past, in which these structures were applied to robot controllers with neuromorphic (i.e. distributed) organization, but not neuromorphic computational units (i.e. neurons) or computational hardware (i.e. hardware-accelerated neurons). Presently, several hexapod robots are controlled with neuromorphic computational units with or without neuromorphic organization, almost always without neuromorphic hardware. In the near future, we expect to see hexapod robots whose controllers include neuromorphic organization, computational units, and hardware. Such robots may exhibit the full mobility of their insect counterparts thanks to a ‘biology-first’ approach to controller design. This perspective article is not a comprehensive review of the neuroscientific literature but is meant to give those with engineering backgrounds a gentle introduction into the neuroscientific principles that underlie models and inspire neuromorphic robot controllers. A historical summary of hexapod robots whose control systems and behaviors use neuromorphic elements is provided. Robots whose controllers closely model animals and may be used to generate concrete hypotheses for future animal experiments are of particular interest to the authors. The authors hope that by highlighting the decades of experimental research that has led to today’s accepted organization principles of arthropod nervous systems, engineers may better understand these systems and more fully apply biological details in their robots. To assist the interested reader, deeper reviews of particular topics from biology are suggested throughout.

 

This work presents an in-depth numerical investigation into a hypothesized two-layer central pattern generator (CPG) that controls mammalian walking and how different parameter choices might affect the stepping of a simulated neuromechanical model. Particular attention is paid to the functional role of features that have not received a great deal of attention in previous work: the weak cross-excitatory connectivity within the rhythm generator and the synapse strength between the two layers. Sensitivity evaluations of deafferented CPG models and the combined neuromechanical model are performed. Locomotion frequency is increased in two different ways for both models to investigate whether the model’s stability can be predicted by trends in the CPG’s phase response curves (PRCs). Our results show that the weak cross-excitatory connection can make the CPG more sensitive to perturbations and that increasing the synaptic strength between the two layers results in a trade-off between forced phase locking and the amount of phase delay that can exist between the two layers. Additionally, although the models exhibit these differences in behavior when disconnected from the biomechanical model, these differences seem to disappear with the full neuromechanical model and result in similar behavior despite a variety of parameter combinations. This indicates that the neural variables do not have to be fixed precisely for stable walking; the biomechanical entrainment and sensory feedback may cancel out the strengths of excitatory connectivity in the neural circuit and play a critical role in shaping locomotor behavior. Our results support the importance of including biomechanical models in the development of computational neuroscience models that control mammalian locomotion. 

Animal locomotion is influenced by a combination of constituent joint torques (e.g., due to limb inertia and passive viscoelasticity), which determine the necessary muscular response to move the limb. Across animal size-scales, the relative contributions of these constituent joint torques affect the muscular response in different ways. We used a multi-muscle biomechanical model to analyze how passive torque components change due to an animal’s size-scale during locomotion. By changing the size-scale of the model, we characterized emergent muscular responses at the hip as a result of the changing constituent torque profile. Specifically, we found that activation phases between extensor and flexor torques to be opposite between small and large sizes for the same kinematic motion. These results suggest general principles of how animal size affects neural control strategies. Our modeled torque profiles show a strong agreement with documented hindlimb torque during locomotion and can provide insights into the neural organization and muscle activation behavior of animals whose motion has not been extensively documented. 

(1) Background: An iterative learning control (ILC) strategy was developed for a “Muscle First” Motor-Assisted Hybrid Neuroprosthesis (MAHNP). The MAHNP combines a backdrivable exoskeletal brace with neural stimulation technology to enable persons with paraplegia due to spinal cord injury (SCI) to execute ambulatory motions and walk upright. (2) Methods: The ILC strategy was developed to swing the legs in a biologically inspired ballistic fashion. It maximizes muscular recruitment and activates the motorized exoskeletal bracing to assist the motion as needed. The control algorithm was tested using an anatomically realistic three-dimensional musculoskeletal model of the lower leg and pelvis suitably modified to account for exoskeletal inertia. The model was developed and tested with the OpenSim biomechanical modeling suite. (3) Results: Preliminary data demonstrate the efficacy of the controller in swing-leg simulations and its ability to learn to balance muscular and motor contributions to improve performance and accomplish consistent stepping. In particular, the controller took 15 iterations to achieve the desired outcome with 0.3% error. 

How we interact with our environment largely depends on both the external cues presented by our surroundings and the internal state from within. Internal states are the ever-changing physiological conditions that communicate the immediate survival needs and motivate the animal to behaviorally fulfill them. Satiety level constitutes such a state, and therefore has a dynamic influence on the output behaviors of an animal. In predatory insects like the praying mantis, hunting tactics, grooming, and mating have been shown to change hierarchical organization of behaviors depending on satiety. Here, we analyze behavior sequences of freely hunting praying mantises ( Tenodera sinensis ) to explore potential differences in sequential patterning of behavior as a correlate of satiety. First, our data supports previous work that showed starved praying mantises were not just more often attentive to prey, but also more often attentive to further prey. This was indicated by the increased time fraction spent in attentive bouts such as prey monitoring, head turns (to track prey), translations (closing the distance to the prey), and more strike attempts. With increasing satiety, praying mantises showed reduced time in these behaviors and exhibited them primarily towards close-proximity prey. Furthermore, our data demonstrates that during states of starvation, the praying mantis exhibits a stereotyped pattern of behavior that is highly motivated by prey capture. As satiety increased, the sequenced behaviors became more variable, indicating a shift away from the necessity of prey capture to more fluid presentations of behavior assembly. 

Our group is developing a cyber-physical walking system (CPWS) for people paralyzed by spinal cord injuries (SCI). The current CPWS consists of a functional neuromuscular stimulation (FNS) system and a powered lower-limb exoskeleton for walking with leg movements in the sagittal plane. We are developing neural control systems that learn to assist the user of this CPWS to walk with stability. In a previous publication (Liu et al., Biomimetics, 2019, 4, 28), we showed a neural controller that stabilized a simulated biped in the sagittal plane. We are considering adding degrees of freedom to the CPWS to allow more natural walking movements and improved stability. Thus, in this paper, we present a new neural network enhanced control system that stabilizes a three-dimensional simulated biped model of a human wearing an exoskeleton. Results show that it stabilizes human/exoskeleton models and is robust to impact disturbances. The simulated biped walks at a steady pace in a range of typical human ambulatory speeds from 0.7 to 1.3 m/s, follows waypoints at a precision of 0.3 m, remains stable, and continues walking forward despite impact disturbances and adapts its speed to compensate for persistent external disturbances. Furthermore, the neural network controller stabilizes human models of different statures from 1.4 to 2.2 m tall without any changes to the control parameters. Please see videos at the following link: 3D biped walking control .